Efficient unconstrained black box optimization
نویسندگان
چکیده
Abstract For the unconstrained optimization of black box functions, this paper introduces a new randomized algorithm called . In practice, matches quality other state-of-the-art algorithms for finding, in small and large dimensions, local minimizer with reasonable accuracy. Although our theory guarantees only minimizers heuristic techniques turn into an efficient global solver. very thorough numerical experiments, we found most cases either minimizer, or where could not be checked, at least point similar to best competitive solvers. smooth, everywhere defined it is proved that, probability arbitrarily close 1, basic version finds $${{\mathcal {O}}}(n\varepsilon ^{-2})$$ O ( n ? - 2 ) function evaluations whose unknown exact gradient 2-norm below given threshold $$\varepsilon >0$$ > 0 , n dimension. smooth convex case, number improves {O}}}(n\log \varepsilon ^{-1})$$ log 1 (strongly) case n\varepsilon This known recent complexity results reaching slightly different goal, namely expected Numerical show that effective robust comparison solvers on test problems Gould et al. (Comput Optim Appl 60:545–557, 2014) Jamil Yang (Int J Math Model Numer 4:150, 2013) 2–5000 variables.
منابع مشابه
ROCK∗ - Efficient black-box optimization for policy learning
Robotic learning on real hardware requires an efficient algorithm which minimizes the number of trials needed to learn an optimal policy. Prolonged use of hardware causes wear and tear on the system and demands more attention from an operator. To this end, we present a novel black-box optimization algorithm, Reward Optimization with Compact Kernels and fast natural gradient regression (ROCK). O...
متن کاملEfficient Global Optimization of Expensive Black-Box Functions
In many engineering optimization problems, the number of function evaluations is severely limited by time or cost. These problems pose a special challenge to the field of global optimization, since existing methods often require more function evaluations than can be comfortably afforded. One way to address this challenge is to fit response surfaces to data collected by evaluating the objective ...
متن کاملEfficient Surrogate Assisted Optimization for Constrained Black-Box Problems
Modern real-world optimization problems are often high dimensional and subject to many constraints. These problems are typically expensive in terms of cost and computational time. In order to optimize such problems, conventional constraintbased solvers require a high number of function evaluations which are not affordable in practice. Employment of fast surrogate models to approximate objective...
متن کاملAn Efficient Conjugate Gradient Algorithm for Unconstrained Optimization Problems
In this paper, an efficient conjugate gradient method for unconstrained optimization is introduced. Parameters of the method are obtained by solving an optimization problem, and using a variant of the modified secant condition. The new conjugate gradient parameter benefits from function information as well as gradient information in each iteration. The proposed method has global convergence und...
متن کاملA A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization
This paper proposes a competitive divide-and-conquer algorithm for solving large-scale black-box optimization problems, where there are thousands of decision variables, and the algebraic models of the problems are unavailable. We focus on problems that are partially additively separable, since this type of problem can be further decomposed into a number of smaller independent sub-problems. The ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematical Programming Computation
سال: 2022
ISSN: ['1867-2957', '1867-2949']
DOI: https://doi.org/10.1007/s12532-021-00215-9